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ABSTRACT 


Sorting is a fundamental operation in computer science and programming that plays a crucial role in various applications. This 
research paper explores the significance of sorting algorithms, discussing their impact on efficiency, performance, and the overall 
quality of programming solutions. We delve into the different types of sorting algorithms, their characteristics, and their relevance in 
solving real-world problems. Additionally, we examine the complexity analysis of sorting algorithms and discuss various factors to 
consider when selecting an appropriate sorting algorithm. Through this comprehensive analysis, we aim to emphasize the 
indispensability of sorting in programming and its wide-ranging implications in diverse domains. 


1. INTRODUCTION 

A Data Structure is design for how to store the data and sorting 
the data. Sorting is arranging the records in some logical order, 
commonly in ascending or descending order. Sorting is a 
fundamental operation in computer science and has significant 
implications for the efficiency of algorithms and the 
performance of computer systems. Sorting is a fundamental 
operation in computer science and plays a critical role in data 
structure research. Sorting allows data elements to be arranged 
in a specific order, typically in ascending or descending order, 
making data processing faster and more efficient. As data sets 
continue to grow in size, the need for efficient sorting algorithms 
becomes more critical, and researchers are continually 
developing new techniques for sorting data quickly and 
efficiently. There are some sorting algorithms are Bubble Sort, 
Selection Sort, Insertion Sort, Merge Sort, Quick Sort, Heap 
Sort, and Radix Sort. Each of these algorithms has a different 
time complexity and space complexity, making them suitable for 
different types of data and applications. 


1.1 Importance of Sorting: 
Sorting plays a critical role in computer science and data 
structure. It helps in finding, searching, and retrieving data 
quickly and efficiently. Sorting makes data processing faster and 
more efficient, especially when dealing with large data sets. 
Here are some of the reasons why sorting is essential in data 
structure: 
1. Search Algorithms: 
Search algorithms rely heavily on sorted data for fast and 
efficient retrieval. For example, binary search algorithms 
require the data to be sorted in order to find a specific 
element quickly. If the data is not sorted, the algorithm may 
need to perform a linear search, which is much slower. 


2. Database Management: 
Sorting is critical in managing databases. Databases use 
indexing techniques that rely on sorted data to quickly 
retrieve information. Without sorting, databases would 
become slow and inefficient. 


3. Data Analysis: 
Sorting is crucial in data analysis. In data analytics, large 
data sets need to be sorted to find patterns and trends. 


Sorting makes the process of analyzing data faster and 
more efficient. 


4. Computer Systems: 
Sorting can significantly improve the performance of 
computer systems. When data is sorted, it can be stored ina 
way that makes it easier to retrieve and process. This can 
help in optimizing the use of memory and processing 
power, leading to better overall system performance. 


2. METHOD OF SORTING ALGORITHMS: 

There are two categories of sorting methods: 

1. Comparison-based Sorting: Comparison sorting is a class of 
sorting algorithms that use pairwise comparisons between 
elements to determine their relative order. 


2. Non-comparison-based Sorting: Non-comparison-based 
sorting refers to sorting algorithms that do not rely on 
pairwise comparisons between elements to determine their 
order. 


2.1 Comparison Based Sorting Algorithms: 


Bubble Sort: 

Bubble Sort is a compares near to elements in a list and if the first 
element is greater than the next element then swaps them. This 
process is repeated up to the list is sorted. 


Algorithm: 
1. Start 
2. forall elements of list 
3. ifA[J]>A[J+1] 
4. swap(A[J], A[J+1]) 


[end if] [end for] 
5. Exit 
Example: 


Input: [8, 2, 1,4] 

Pass 1:[8, 2, 1, 4] compare first element to another elements 8>2, 
8>1, 8>4 

Pass 2: [2, 1, 4, 8] compare first element to second 2>1 

Pass 3:[1, 2,4, 8] No change 1<2 
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Selection Sort: 

Selection Sort is that sorts an array by repeatedly finding the 
smallest element from the unsorted array and placing it at the 
starting of the array. 


Algorithm: 
Here N, Jisa variable, A is array 
1. Start 
2. for N=1 to length[A ]-1 (finding minimum value) 
3. min=A [N] 
4. for J=N+1 to length[A] (for comparison) 
2: if (min>A [N]) 
6. min=A [J], Loc=J [End if] [End ofinner loop] 
7. Swap (A [Loc], A[N]) [End of OUTER loop] 
8. Exit 
Example: 
Pass |All] |AI2] |AB] | Al4l | AIS] | Al) | AI7] | AI] 
I 78 32 43 10 84 22 65 54 
2 10 32 B 78 84 22 65 54 
3 10 2 4B 78 84 32 65 54 
4 10 22 32 78 84 BB 65 54 
5 10 2 32 43 84 [78 65 54 
6 10 2 32 B 54 [78 65 84 
10 2 32 B 54 65 78 84 
Sorted | 10 2 32 B 54 65 78 84 
Insertion Sort: 


Insertion sort is a sorting elements in an array one by one. It is an 
in-place, comparison-based sorting algorithm. The algorithm 
works by check over the input array and inserting each element 
into its correct position in anew, sorted array. 


Algorithm: 

1. fori=1toL(A)do 
2. value=Afi], j=i-1 
3. whilej>=0 and A[j]> value 
4. Afjt+l]=AGj] 
5 


J=1-1 
end while 
6. Af[j+l]=value 
end for end function 
Example: 
A{1] A[(2] A[3] A[4] A[5] 
Input 13 12 14 7 8 
13 12 14 7 8 
Pass 1 | 12 13 14 7 8 
Pass2 | 12 13 14 7 8 
Pass3 | 12 13 14 7 8 
12 13 7 14 8 
12 7 13 14 8 
7 12 13 14 8 
Pass4 | 7 12 13 14 8 
7 12 13 8 14 
7 12 8 13 14 
Sorted | 7 8 12 13 14 
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Merge Sort: 

Merge sort is a popular and efficient sorting algorithm that 
divides a list of elements into smaller sub-lists, sorts those sub- 
lists recursively, and then merges them to produce a sorted list of 
elements. 


Algorithm: 
N= Element, array A using auxiliary array B 
1. Set L=1 [Initialize] 


we Repeat step 3 to 6 while L<N 
3% Call MERGE(A, N, L, B) 
4. Call MERGE(B, N, 2 *L, A) 
Be Set L=4*L [End of step 2 loop] 
6. Exit 

Example: 


Step 1: Divide the input array into two equal parts 
(37, 28, 42, 2] and [8, 83, 11] 


Step 2: sorting each half of the array 
[37, 28, 42,2] — [2, 28, 37, 42] 
[8, 83, 11] > [8, 11, 83] 


Step 3: Merge the two sorted sub-arrays 
Merging [2, 28, 37,42] and [8, 11, 83] 
[2, 8, 11, 28, 37, 42, 83] 


Step 4: Return the sorted array 
[2, 8, 11, 28, 37, 42, 83] 


Quick Sort: 

Quick sort is selecting a centre element from the array and divide 
into two sub-arrays, conforming to they are less or greater than 
the centre. The sub-arrays are then sorted repeated using the 
same process until the array is sorted. 


Algorithm: 
1. Start 
2. if (begin < exit) 
3. p=partition(A, begin, exit) 
4. QS(A, begin, p- 1) 
a: QS(A, p+ 1, end) 
6. Exit 
Example: 
36 | 50 16 27 82 | 20 91 | 47 
36 [20 16 27 82 50 91 [47 
27 | 20 16 36 82 50 91 l 47 
27 [20 [16 82 50 91 [47 
15 | 20 27 82 50 47 {91 
47 | 50 82 | 91 
[15 _ | 20 [ au _ | 36 47 |} 50 a= | 82 [91 
Heap Sort: 


Heap sort is a works by first constructing a heap from the input 
data, and then repeatedly removing the maximum element from 
the heap and placing it at the end of the sorted array. It is a binary 
structure. A binary heap is a complete binary tree where each 
node is greater than or equal to its children, in the case of a max- 
heap, or less than or equal to its children, in the case of a min- 
heap. Heapify is used to maintain the heap property when an 
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element is inserted or removed from the heap. 


Algorithm for heapify: 
1. heapify(array) 
2: Root=array[0] 
3. Largest = largest( array[0] , array [2 * 0+ 1]/ array[2 * 
0+2)) 
4. if(Root != Largest) 
3: Swap(Root, Largest) 


Example: 

Step 1: we build a max-heap from the input array by calling 
heapify on each non-leaf node in reverse order. 

Initial array: [5, 2,9, 1,5] 

After heapify(array, 5, 1): [5, 1,9, 2,5] 

After heapify(array, 5, 0): [9, 1,5, 2,5] 


Step 2: After building the max-heap, we repeatedly extract the 
maximum element from the heap and place it at the end of the 
array. 


2.2 Non Comparison Based Sorting Algorithms: 

Radix Sort: 

Radix sort is a sort an array of integers by grouping the numbers 
by their digits. It is a non-comparative integer sorting algorithm 
that sorts integers by examining their individual digits. The 
algorithm works by processing each digit of the integers one by 
one, from the least significant digit to the most significant digit, 
and placing them into bins based on the value of the digit. 


Algorithm: 
RadixSort(a[ ], n): 
1. Finding the maximum element 
max=a[0] 
2. For(i=1 ton-1): 
3. If(a[iJ>max): 
max=a|[i] 
4. For (div=1 to max/div>0): 
countingSort(a, n, div) 


div=div* 10 
5. Exit 
Example: 


Input: [182, 155, 283,581,324] 

Pass 1:[182, 155,283,581, 324] — [581, 182,283,324, 155] 
Pass 2: [581, 182, 283, 324, 155] — [324, 155,581, 182, 283] 
Pass 3: [324, 155,581, 182,283] — [155, 182, 283,324,581] 


Counting Sort: 

Counting sort is an efficient sorting algorithm that works ona set 
of integers with a known range. It operates by counting the 
frequency of each distinct element in the input array and then 
using these counts to determine the correct position of each 
element in the sorted output. 


Algorithm: 
countingSort(array, size) 
max <- find largest element in array 
1. initialize count array with all zeros 
for j <- 0 to size 
2. find the total count of each unique element and store the 
count at jth index in count array 
for i<- 1 tomax 
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3. find the cumulative sum and store it in count array itself 
for j <- size down to | 

4. restore the elements to array 

5. decrease count of each element restored by | 


Example: 
Input: 4, 2,7, 1,5,2 


Ajo) [AQ] [A] | ABI A[4] A[5] A[6] A[7] 

Element4 | 0 0 0 |0 1 0 0 0 
Element 2 0 0 1 | 0 1 0 0 0 
Element 7 0 0 1 10 1 0 0 1 
Element | 0 1 1 0 1 0 0 1 
Element 5 0 1 1 0 1 1 0 1 
Element 2 0 1 2 0 1 1 0 1 
After 0 1 3 3 4 5 5 6 
Modification 

Bucket Sort: 


Bucket sort is a comparison-based sorting algorithm that divides 
an array or list of elements into anumber of buckets or bins. Each 
bucket is then sorted individually, either using a different sorting 
algorithm or by recursively applying the bucket sort algorithm 
itself. After sorting all the individual buckets, the sorted 
elements are concatenated to obtain the final sorted array. 


Algorithm: 
Bucket Sort(A[]) 
1. Let B[0....n-1] be anew array 
2: n=length[A] 
3. for i=0 ton-1 
4. make B[i] an empty list 
D: fori=1 ton 
6. do insert A[i] into list B[n a[i]] 
7. for i=0ton-1 
8. do sort list B[i] with insertion-sort 
9. Concatenate lists B[0], B[1],........ , B[n-1] together in 
order 
10. Exit 
Example: 
[014] [7 |/ df 0 (0.14 
0.79 0.140.17// | 1 (0.17 
0.35 0.22) 0.24 0.27 2 0.22 
0.27 035 / |/ |3 024 
(074) 7 7 |f |4 [027 
0.96 / / / 5 0.35 
0.22 (0.63 |/ |/ | 6 |063) 
0.15 0.74 0.79 / 7 0.74 
0.24 / / / 8 0.79 
0 O97 7 4 (096 
Input Bucket Created Sorted List 


Time Complexity of Sorting Algorithms: 


Time Complexity Space 
Name Complexity 
Best ] Average Worst Worst 
Bubble Sort Q(n) 0(n’2) O(n’2) Od) 
Selection Sort Q(n’2) 6(n’2) O(n’2) O(1) 
Insertion Sort Q(n) 0(n42) O(n’2) O(1) 
Merge Sort Q(n log(n)) 0(n log(n)) O(n log(n)) O(n) 
Quick Sort Q(n log(n)) 0(n log(n)) O(n’2) O(n) 
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Heap Sort Q(n log(n)) 0(n log(n)) O(n log(n)) O(1) 

Radix Sort Q(nk) @(nk) O(nk) O(n + k) 

Counting Sort Q(n +k) 6(n +k) O(n +k) O(k) 

Bucket Sort O(ntk) O(n) O(n’2%) O(ntk) 
CONCLUSION: 


By examining the various types of sorting algorithms, their 
efficiency and performance characteristics, and their 
applications in real-world scenarios, this research paper 
highlights the essential role that sorting plays in programming. 
The insights gained from this analysis can guide developers and 
researchers in selecting the most appropriate sorting algorithm 
for their specific needs and help them optimize their code to 
achieve efficient and effective solutions to a wide range of 
problems. Recap of the importance of sorting in programming, 
future directions and emerging trends in sorting algorithms. 


REFERENCES 

1. https://www.irjet.net/archives/V 5/i4/IRJET-V51459 pdf 

2. Book of Data structures a pseudocode approach with C++ through 
Gilberg Forouzan 

3. Data Structure Seymour Lipschutz 

4. https://www.tutorialspoint.com/data_structures_algorithms/bubbl 
e_sort_algorithm.htm 

5. https://www.geeksforgeeks.org/time-complexities-of-all-sorting- 
algorithms/ 

6. https://medium.com/nerd-for-tech/counting-sort-radix-sort- 
ccd9f77a00a2 

7.  https://www.enjoyalgorithms.com/blog/why-should-we-learn- 
sorting-algorithms 

8. https://www.programiz.com/dsa/selection-sort 


International Education & Research Journal [IERJ] 


